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Abstract. We will show that tight frames satisfying the restricted 
isometry property give rise to nearly tight fusion frames which are nearly 
orthogonal and hence are nearly equi-isoclinic. We will also show how to 
replace parts of the RIP frame with orthonormal sets while maintaining 
the RIP property. 

1. Introduction 

Fusion frames are a generalization of frames. Fusion frames were intro- 
duced in [8] under the name frames of subspaces and quickly found ap- 
plication to problems in sensor networks, distributed processing and more 
[9j [TO] 117] . For a comprehensive view of the papers on fusion frames 
we refer the reader to www.fusionframes.org. While frames decompose a 
vector into scalar coefficients, fusion frames decompose a vector into vec- 
tor coefficients which can be locally processed and later combined. Fusion 
frames are designed to handle modern techniques for information processing 
which today emphasizes distributed processing. They allow data processing 
to become a two step process where we first perform local processing at 
individual nodes in the system and this is followed by integration of these 
results at a central processor. This has application to packet-based network 
communications, sensor networks, radar imaging and more [1]. This hier- 
archical processing helps to design systems which are robust against noise, 
data loss, and erasures [TJ [10] [17] I16j. Much of the work on fusion frames 
has surrounded the construction of fusion frames with specialized properties 

[3 El El [20]. 

Our goal here is to use tools from compressed sensing, namely matrices 
with the restricted isometry property, to construct fusion frames with very 
strong properties. Compressed sensing is a very hot topic today because of 
its broad application to problems in sparse signal recovery. There is so much 
literature in this area it is not possible to adequately represent it here so we 
refer the reader to two recent tutorials on the subject and their references 
[131 119] . A fundamental tool in this area is the restricted isometry property 
(RIP) (See section [4] for definitions). This is a very powerful property for a 
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family of vectors {pi}^ in Hn which yields that subsets of a fixed size are 
nearly orthonormal. As such, it is quite difficult to produce such families 
of vectors of the needed sizes and they are constructed by probabilistic 
methods. It is a fundamental open problem in the area to give a concrete 
construction of RIP vectors of the appropriate sizes. 

In this paper, we will use tight frames of RIP matrices to construct fusion 
frames with some very strong properties. First we will show that we can 
construct nearly tight fusion frames which still have the RIP property. Next, 
we will construct fusion frames with additional strong properties such as 
being nearly equi-isoclinic. Finally, we will see how to replace subsets of our 
RIP family with orthonormal sequences while tracking the change in the 
RIP constants. 

2. Frames and Fusion Frames 

Fusion frames are a generalization of frames. 

Definition 2.1. A family of vectors {ifi}i^i in a Hilbert space % is a frame 
for H if there are constants 0<A<B<ooso that for all <p G % we have 

A\\ipf <Y,\(<P,W)\ 2 < B\M 2 - 

The numbers A, B are lower (respectively, upper) frame bounds for the 
frame. If A = B it is an A-tight frame and if A = B = 1, it is a Parseval 
frame. If \\(fi\\ = c for all i G I this is an equal norm frame and if c = 1 it is 
a unit norm frame. The analysis operator of the frame is T : Tijy — > £2 (M) 
given by 

M 
i=l 

where {ei}^ is the coordinate orthonormal basis of l2{M). The synthesis 
operator is T* and is given by 

(M \ M 

^Oiei I = ^anpi. 
i=i ) i=i 

The frame operator is the positive self-adjoint invertible operator S = T*T 
and satisfies 

M 

i=i 

Reconstruction is given by 

M M 

¥> = ^(v^^S^Pi = ^2((p,S- 1/2 ipi)S- 1/2 ipi. 
i=i i=i 

In particular, {S' -1 / 2 ^}^ is a Parseval frame for Wjy. 
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Frame theory has application to a wide variety of problems in signal pro- 
cessing and much more (see the monographs [141 [Tl] for a comprehensive 
view). Fusion frames are a generalization of frames and were introduced in 
[8]. While frames decompose a signal into scalar coefficients, fusion frames 
decompose signals into vector coefficients which can then be locally pro- 
cessed and later combined to draw global conclusions. 

Definition 2.2. Given a Hilbert space % and a family of closed subspaces 
{Wi}i£i with associated positive weights Vi, i G I, a collection of weighted 
subspaces {(Wj, * s a fusion frame for T~L if there exist constants < 

A < B < oo satisfying 

A\\ip\\ 2 < ^2vf\\Pnp\\ 2 < B\\ip\\ 2 for any peW, 
iel 

where Pi is the orthogonal projection onto Wi- 

The constants A and B are called fusion frame bounds. A fusion frame is 
called tight if A and B can be chosen to be equal, Parseval if A = B = 1, 
and orthonormal if 

% = QieiWi. 

For < e < 1, the fusion frame is e-nearly tight if there is a constant C so 
that A = j^C, B = (1 + e)C. The fusion frame is equi- dimensional if all 
its subspaces Wi have the same dimension. 

Notation 2.3. If {W-i}i & i are subspaces of'Tiiy, we define the space 

I ® W i ) = WiWI ^ e Wi and ||^|| 2 < oo}, 
Kiel ) i 2 iel 

with inner product given by 

iel 

The analysis operator of the fusion frame is the operator 

T:n N ^ lj2®wA , 

Kiel J h 

given by 

T((p) = {viPi<p} ieI . 
The synthesis operator of the fusion frame is T* and is given by 

T* ({&}*=/) = J>i&. 

iel 

The fusion frame operator is the positive, self-adjoint and invertible op- 
erator Sw '■ H — > H given by 

SwV = ^ v 1Pi L P^ f° r & h <p G H. 
iel 
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It is known [10] that {Wi, is a fusion frame with fusion frame bounds 

A, B if and only if AI < Sw < BI. Any signal ip £ H can be reconstructed 
[lOj from its fusion frame measurements {v iPup}^ by performing 



A frame {(fi}i£i can be thought of as a fusion frame of one dimensional 
subspaces where W% = span {(pi} for all i £ I. The fusion frame is then 
{Wi, \\<Pi\\}- A difference between frames and fusion frames is that for frames, 
an input signal <p £ % is represented by a collection of scalar coefficients 
{{<p, <Pi)}iei that measure the projection of the signal onto each frame vector 
(fi, while for fusion frames, an input signal ip £ % is represented by a 
collection of vector coefficients {Jlw. (y?)}i 6 j corresponding to projections 
onto each subspace Wi. 

Much work has been put into the construction of fusion frames with spec- 
ified properties [2J [U E] . We also have a generalization of fusion frames using 
non-orthogonal projections [3]. 

There is an important connection between fusion frame bounds and bounds 
from frames taken from each of the fusion frame's subspaces [?]. 

Theorem 2.4. For each i £ I, let i>i > and Wi be a closed subspace of%, 
and let {^ijljeJi be a frame for Wi with frame bounds A{, Bi. Assume that 
< A = inf j g / Ai < supj e j Bi = B < oo. Then the following conditions 
hold: 

(1) {Wi, Vi}i£i is a fusion frame for H. 

(2) {vitpij}i & ij &Ji is a frame for U. 

In particular, if {Wi^^j^j^i^i is a fusion frame for Ti with fusion frame 
bounds C, D, then {vnfiytieijeJi is a frame for % with frame bounds AC, BD. 
Also, if {viipij}i & i i j£j i is a frame for H with frame bounds C, D, then {Wi,Vi, }jeJi}iei 
is a fusion frame for H with fusion frame bounds 

Corollary 2.5. For each i £ I, let Vi > and Wi be a closed subspace of 
Ti. The following are equivalent: 

(1) {Wi, Vi}i£i is a fusion frame for T~L with fusion frame bounds A, B. 

(2) For every orthonormal basis {eij}j£Ki forWi, the family {vie^i^jj^Ki 
is a frame for T~L with frame bounds A, B. 

(3) For every Parseval frame {(pij}i eIt j eJi forW i; the family {vnpij}i e ijeJi 
is a frame for % with frame bounds A, B. 

Corollary 2.6. For each i £ I, let Vi > and Wi be a closed subspace of 
H. The following are equivalent: 

(1) {Wi, Vi}i(zj is a Parseval fusion frame for H. 

(2) For every orthonormal basis {eij}j£Ki forWi, the family {vieij}ieijeKi 
is a Parseval frame for %. 

(3) For every Parseval frame {<pij} ieIj j eJi for W i} the family {vnfijjieije^ 
is a Parseval frame for %. 
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3. e-Rmsz Sequences 
For our work we will need some information concerning e-Riesz sequences. 

Definition 3.1. A family of vectors {<£i}f = i in Hn is a Riesz basis with 
lower (resp. upper) Riesz bounds < A < B < oo if for all scalars {aj}^ 1 
we have 



N 



N 



N 



ay,\^\ 2 < ii J>^n 2 ^ B Y1 



This family of vectors is an e-Riesz basis for T-Ln if for all scalars {ai}f =l 
we have 



N 



N 



N 



1 + e 



J^H 2 < ll^a^H 2 < (l + e ) J] | 



i=i 



The vectors are an e-Riesz sequence if they are an e-Riesz basis for their 
span. 



As one can see, e-Riesz sequences are nearly orthonormal. The next few 
lemmas will formalize this statement. First we recall that for a linearly 
independent set of vectors {tpi}f =l in 1~Ln, the frame bounds of this family 
equal the Riesz bounds. It follows that if S is the frame operator for {<f>i}f =1 
then {S~ 1 / 2 (fi}fL 1 is an orthonormal basis for jHn- 

Proposition 3.2. Let {ifi}f^i be a family of unit norm vectors which is a 
e-Riesz sequence. Then for every partition {IjYj=\ of {1,2, ... , M} we have 
for all scalars {ctj}^ 



M 



^||^ai^|| 2 < J^H 2 < (l + e)^||^a^ 



j=i ieij 



3 = 1 i&Ij 



Hence, 



M 



(1 + e)'- 



^2 ii a ^n 2 - ii ^2 °wii 2 ^ (! + e ) 2 ii X] am 



j=i ieij 



i=i 



j=i ieij 
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Proof. We compute 

v ' j"=i ieij v 7 j=i ieij 



E 

»eur =1 J J - 

r 

EE 

j = l iG/j 



ad 2 



a; 1 2 



< E( 1 + e )iiE a ^n 2 

j=l ieij 
r 

= (i + ^EnE^^n 2 - 

j=\ ieij 

For the hence, we combine the first part of the proposition with the fact 
that 

MM M 

|2 



En 2 ^ iiE«^ii 2 < a+e)Ei 



i=l i=l i=l 

□ 

Lemma 3.3. If {ifii}fLi ^ s an € 'Ri^sz basis for'K^ and let S be the frame 
operator. Then 

t ^/<5<(1 + £ )/. 

Hence, 

l^/Sfl- <(! + «)/. 

In general, if < a then 

1 



(l + e) a 

Hence, if a > then 

1 



/ < S a < (1 + e) a /. 



/ < S- a < (1 + e) a J. 



(l + e) aJ 

Proof. Let T be the analysis operator for the Riesz basis. By the definition, 
for any scalar s {a i }f! =l we have 

N 

im{oi}£i)ii 2 = ii 5>rf ^ (! + e )ii{^}£iii 2 - 

i=l 

And similarly, 

Iin{«i}£i)l| 2 > ^ll{*}£il| 2 - 
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It follows that T satisfies the same inequalities. For any ip 6 T-Ln and any 
< a we have 

(SV,¥>> = <(r*r)V,v) 

= ((T*T) a /V (T*T) a /V) 

= ||(r*r) a/ Vll 2 

< ||(T*T) a/2 || 2 |M| 2 

= ||r*r|| a ||v3|| 2 

< (l + e) a |l^l| 2 - 

This shows that S a < (1 + e) a I. The lower bound is derived similarly. □ 

Finally, we need to measure the angle between spaces spanned by disjoint 
subsets of a e-Riesz sequence. 

Proposition 3.4. Let {(p{\fL l be an e-Riesz sequence and choose any par- 
tition {h,h} of {1,2, . . . ,M}. If<pe span {(pi} ieh and tp £ span {pi} ie i 2 
are unit vectors, then 

1(^)1 <2e(l + |). 
Proof. Let p = Ylieh a " ii P i an( ^ ^ = ^2i&h anc ^ we com P u t e 



rbEN 2 ^ lb- 



i=l 



M 

< (l + e )^| aj |2 



1=1 



Hence, 

M 



2ife(^> < (l + eJ^I^-dl^ + W 2 ) 

i=i 

i=l iG/i 
1 M 

i=i 

2 + 6 " 

T + e^ 1 



c- > \<U.\ 2 - 



i=l 
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Next, we observe that \{(p, 
gether with Proposition 13.21 



max| A | =1 Re(if, Xtp). Thus, we obtain to- 



\(<p,^)\ < e (l + i)_ ^| ai | 2 + ^|a 4 



ieh iel 2 



< c (l + |)(|M| 2 + |H| 2 ) = 2 e (l + |). 



□ 



4. Fusion Frames and the Restricted Isometry Property 

In this section we will show how to use tight frames of vectors which have 
the e-restricted isometry property to construct e-nearly tight fusion frames. 

Definition 4.1. A family of vectors {ipi}iL\ in 1~Ln has the restricted isom- 
etry property with constant < e < 1 for sets of size s < N if for every 
I C {1, 2, . . . , M} with \I\ < s, the family {t^j}j g / is an e-Riesz basis for its 
span. 

The restricted isometry property is one of the cornerstones of compressed 
sensing. Compressed sensing is one of the most active area of research today 
and so we refer the reader to the tutorials \13\ [19] and their references for 
a background in the area. It is known that the optimal e above is on the 
order of 



Now we will see how tight frames of restricted isometry vectors with 
constant e will produce nearly tight fusion frames. 

Theorem 4.2. Let {<fii}f£i be a unit norm tight frame for T~Ln which has 
RIP with constant e for sets of size s. Then for any partition {Ij{^ =l of 
{1, 2, . . . , M} with \Ij\ < s if we let 

Wj = span i€lj pi, 

then {Wj, l}jLi is a fusion frame with fusion frame bounds 

M M(l + e) 
(1 + e)JV' N ' 

Moreover, if L C {1,2, ... ,K} and for j £ L we have Jj C Ij with 
5^7=1 I — s then for all scalars we have 




s , M 



e ~ 



1 



L L K 



1 + e 



ii ai ^n 2 - ii Yl Yl ai ^n 2 - + e ) Y ii Y am 




To prove the theorem we need a lemma. 
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Lemma 4.3. Under the assumptions of the theorem, if Pj is the orthogonal 
projection ofHN onto Wj, then for any <p £ Hn we have: 



1 + 

iei iei 



^El^.w>l 2 <ll^ll 2 <(i + c)EK^w>l 2 - 
(I^IMI^El«rf<(i + ^l 

Proof. Let 5 be the frame operator: 

SV = V'i)^) for all <P ^ %JV- 

16/ 

Let {e^lj^j^ be the eigenbasis for S with eigenvalues 

1 

1 + e 



(1 + e) > Ai > ■ ■ ■ > A|j| > TT - > > > • • • > 0. 



Then 



So 



On the other hand, 



and so 



That is, 



\i\ 
3=1 

||P^|| 2 = ^|(^, ei )| 2 . 

i=i 

M 

(Sp,¥>} = 5^Aj|(yj,ej)| 2 . 

3=1 

W 

|P^|| 2 = X>,e,->| 2 

3=1 

\I\ 

< (l + e )^A,|^,e,)| 2 
i=i 

= (l + e)(S<p,<p) 

= (1 + 6)^|^,^)| 2 
3=1 



10 



B.G. BODMANN, J. CAHILL, AND P.G. CASAZZA 



The other inequality is similar. 

For the hence, we just observe that 

M 
i=l 

□ 

Proof of Theorem 14.21 

For each j = 1, 2, . . . , K let Pj be the othogonal projection of Hjy onto 
Wj. Then by the Lemma 14.31 for any <p £ T~Ln we have: 

K K M 

Y,\\PM 2 < (i+ e )^^|(^^)l 2 = (i+ e )^|(^^)l 2 = (i+e)-|MI 2 . 

j = l j = l ielj i=l 

Similarly, 

ZW >- (r^EEi^«)i 2 - ^ X>*>i J ^ jihi> 1 

j=i v ^ ; j=i ielj y ' i=i v ; 

This completes the proof. 

5. Nearly Equi-Isoclinic Fusion Frames and the Restricted 

Isometry Property 

In this section, we will see how to use tight frames of vectors with the 
restricted isometry property to construct nearly equi-isoclinic fusion frames. 

Definition 5.1. Given two subspaces W\,W<i of a Hilbert space % with 
dim W\ = k < dim W2 = t, the principal angles (9i,02, ■ ■ ■ Ok) between the 
subspaces are defined as follows: The first principal angle is 

#1 = minjarccos \(tp, ip}\ : tp G Swi,i> 6 Sw 2 } 

where S\Yi = £ W t : \\tp\\ = 1}. Two vectors <pi,ipx are called principal 
vectors if they give the minimum above. 

The other principal angles and vectors are then defined recursively via 

9{ = mm{arccos \ (tp, tp)\ : tp E Sw 1 ,ip G Sw 2 > and tp J_ ipj, ip _L ipj,l < j < i— 

Definition 5.2. Two k-dimensional subspaces W\,W2 of a Hilbert space 
are isoclinic with parameter A, if the angle 9 between any ip £ W\ and its 
orthogonal projection Pip in W2 is unique with cos 2 9 = A. 

Multiple subspaces are equi-isoclinic if they are pairwise isoclinic with the 
same parameter A. 

An alternative definition is given in |12| where two subspaces are called 
isoclinic if the stationary values of the angles of two lines, one in each sub- 
space, are equal. The geometric characterization given by Lemmens and 
Seidel [18] is that when a sphere in one subspace is projected onto the other 
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subspace, then it remains a sphere, although the radius may change. This is 
all equivalent to the principal angles between the subspaces being identical. 

Much work has been done on finding the maximum number of equi- 
isoclinic subspaces given the dimensions of the overall space and the sub- 
spaces (and often the parameter A). Specifically, Seidel and Lemmens [H] 
give an upper bound on the number of real equi-isoclinic subspaces and 
Hoggar [15] generalizes this to vector spaces over R and C. 

Definition 5.3. Two K- dimensional subspaces W\,W2 with associated or- 
thogonal projections P\ and P 2 are isoclinic with parameter A > if 

P 1 P 2 P 1 = \P 1 and P 2 PiP 2 = AP 2 . 

A family of subspaces {Wj} is e-nearly equi-isoclinic if there exists A > 
such that for every two subspaces Pi and Pj, i 7^ j , 

(A - e 2 )Pi < PiP 2 Pi < (A + e 2 )Pi and (A - e 2 )P 2 < P 2 PiP 2 < (A + e 2 )P 2 . 

We will call a equi- dimensional fusion frame {Wi}jL i e-nearly equi-isoclinic 
if its subspaces {Wi}^ =1 are e-nearly equi-isoclinic. 

It can be checked that a fusion frame {Wi, is e-nearly equi-isoclinic 
if and only if the squared cosines of the principal angles between any two of 
its subspaces are within e 2 of a fixed A. 

A related property is: 

Definition 5.4. A fusion frame {Wi,Vi}fL l is e-nearly orthogonal if when- 
ever we take unit vectors if G Wi and ip G Wj for l<i^j<Kwe have 

\M)\ < e- 

An e-nearly orthogonal fusion frame is e-nearly equi-isoclinic by default 
in the sense that it satisfies the definition with A = 0. 

Theorem 5.5. Let {vi}i=i be a unit norm tight frame for Hn which has 
the restricted isometry property with constant e for sets of size s . Then for 
any partition {Ij}^ =l of {1, 2, . . . , M} with \Ij\ < | if we let 

Wj = span ieIj ifi, 
then {Wj, l}jLi * s a (--tight fusion frame with fusion frame bounds 

M M(l + e) 
(1 + e)N' N ' 

Moreover, this is a 2e(l + e) 2 -nearly orthogonal fusion frame and hence it is 
a 2e(l + e) 2 -nearly equi-isoclinic fusion frame. 

Proof. The first part of the theorem is immediate by Theorem 14.21 and the 
moreover part is immediate by Proposition 13.41 □ 
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6. The Restricted Isometry Property with Orthonormal 

Subsets 

A natural problem is the following: 

Problem 6.1. Can we construct a family of vectors {'Pi}fL l in%N with the 
restricted isometry property with constant < e < 1 for sets of size s our of 
orthonormal bases for T~Ln? Or, can they be constructed from orthonormal 
sequences each having s elements? 

We will now look at how we might try to alter a family of vectors with the 
RIP property to a set which contains orthonormal sequences with s vectors 
each. We will need a lemma for this proof. 

Lemma 6.2. Let Wi,W2 be subspaces of Un and let T : W\ — > W2 be a 

surjection which satisfies 

\\ip — T(p\\ 2 < e\\(p\\ 2 , for all ip 6 W\. 
Let P\ be the orthogonal projection ofH-N onto W\. Then 

H - < 4 (T37)I IMI 2 , for all V € W 2 . 

Hence, 

\\PM 2 > (i - (T^M 2 ! - 

Proof. First note that for any ip 6 W\ 

(l-e) 2 |M| 2 <||T^|| 2 <(l + e) 2 |M| 2 . 
Next we have for any ip 6 W\ 

ll^-TVH 2 = y-P.TtpW 2 = ||P 1 (/-2>|| 2 + ||(/-P 1 )(/-2>|| 2 < eii^n 2 . 
Let ip £ W2. Choose p G W\ so that Tip = ip. Now we compute 

U-p^W = U-PiTip\\ 

< 11^-^11 + y -PiTp\\ 

< llT^-^H + ll^-PiT^II 

< v^lMI + y/e\\<p\\ 

< 2^||T-V|| 

< s^llT- 1 ) 

< 2^L 
~ 1 - e 

For the hence, we note that by Pythagoras 

"-\\(I-Pi 
4e 

□ 
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Now we are ready for the construction of RIP families which contain 
orthonormal sets. 

Theorem 6.3. Let {<Pi}f^i be a family of vectors inH^ having the restricted 
isometry property with constant < e < 1 for sets of size s. Partition 
{1, 2, . . . , M} into sets {Ij}f =1 with \Ij\ < s for all j = 1, 2, . . . , K. For each 
j let Sj be the frame operator for {(pi}^^ . For K\ < K, replace for ach 

— 1/2 

j < K\ the family {(^jigr. by {5- ipi}i^i, , which is an orthonormal basis 



for its span. Then {Sj 1/2 (pi}ieiy,j=i,2,...,K 1 U {<fi}iei r .Ki+i<j<K =■ {V>i}£ii 
has the restricted isometry property and for sets J C {1,2, . . . , M} with 
\J\ < s we have for all families of scalars {ai}i^j, 

/ \ V2 



1 ~ 46/(1 - eY 

(1 + 6)2 



4e(l + e) v / i^i 



\ieJ 



<||J>^||< [((1 + 6) 3 / 2 + 46(1 + 6)7^] (^H 2 ) 



1/2 



Proof. Choose a subset J C {1, 2, . . . , M with | J| < s and let Jj = Jnlj for 
all j = 1, 2, . . . , K. For each 1 < j < K\ let Pj be the orthogonal projection 

— 1/2 

of 7-Ln onto span {Sj ipi}i € j r Choose any scalars {ai}nzj j -j = \ ) 2... y K- Then 
(!) II E P J ^aiS~ 1/2 ipi+ E E^IU'E^ - ^) ^2 a i s J 1/2 <Pi\\ 

3=1 i&Jj j=K\+\ i&Jj i=l i£Jj 

Kx K 

- I' E E a i S ~ 1/2l Pi + E ^2 a WiW 
j=l ieJj j=K!+l 

Kx K I<! 



<iiE^E a ^7 <p*+ E E a ^ii + iiE( J -^)E a ^: 



-1/2 



3=1 ieJj 



j=Ki+l ieJj 



3=1 



We will consider the above two sums separately. By Lemma 13.31 we have 

2 



(i-s: 



-1/2x2 



< 1 



1 



/ < 



1 + 6 



Applying Lemma 13.31 and using T = in Lemma 16.21 we have for all 

j = l,2,...,K 1 

7-1/2 



lld-^E^^II < Tr~rzL)2 E 



l + e> \i£Jj 



1/2 



46(1 + 6) E 



v ie Jj 
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Hence, 



(2) \\j2(i-Pi)Y, a i s > 



-1/2 



< Eik'-^oE^ 



-1/2 



j=i 



3=1 



Ki 



1/2 



< 4e(l + e)E El a< l 

i=i yeJj 

< 46(1 + 6)^ EZ> 

\i=i ie Jj 

For the second term, since the vector 

JSa K 

E p j E + E E ai ^' 

j=l i€ Jj j=K 1 + l iGJj 

is contained in the span of the vectors {</?i}iGJ:.j'=i,2 ) ...,A" an d 

^|J,| = |J|< S , 

i=i 

which is an e-Riesz sequence, we have by Proposition [37 

K x K 
-V2 „ i|2 



+ 



Eiii J iE^ / >*ii a + E ii E 



j'=l iGJj 
Ai 



j=Ai+l iGJj 



< (1 + e 



— 1/2 

Since {«S ■ </>i}iGJ- is an orthonormal set, we have 



- ii E p j E ai5 i ^ + E E a ^ii 2 

3=1 i£Jj j=Ki+lieJj 

K\ K 

Eh^'E^^j ^n 2+ E II E a ^'' 

3=1 ieJj j=Kx+l ieJj 



A'i 



(3) 



Eii^E^7 1/ Vf+ E ii E 



A" 



anpi\ 



j=l ieJj 



j=Kx+l 

K 



<£iiE«^ 1/a rf+(i+«) E E 

3=1 i&Jj j=K 1 +li£j j 

= EEN 2 + d + e ) £ Ew 2 

3=1 ieJj j=Ai + l iGJj 

<(l + 6)^|a,| 2 . 

iGJ 
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Similarly, applying the hence from Lemma 16.21 we have 

(4) Eii p iE^7 1/2 ^n 2 + E iiE a ^n 2 

3 = 1 i&Jj j=K!+l i&Jj 

>(i-4 £ / ( i-^)f;iiyja,s;" Vi ||2 + i £ ^ 

j=l iGJj V ' j=Kx+l ieJj 

= a - 4*/(i -) 2 )EEW 2 + 7i^y E En 2 

j=lieJj ' j=Ki+li€Jj 

>(1- 46/(1 -6) 2 )El«i! 2 - 

Putting this second part together we have 

iiE^'E * 5 '/ 172 ^"^ E E^^n 2 



<(l + e) 



Eifi-E< 2 ^i 2 + E ii E 

i=i «eJj j=RTi+i ieJj 

2 



<(l + e) 3 E 



a. 



Similarly, 

(5) 



K\ K 

E p j E ai5 7 1/2 <^ + e E ai ^n 2 

j=i iej- j=Ki+iieJj 



> 



1 



A" 



Eii^'E '^ ^n 2 + E nE ai ^ 

j=i ieJj j=Ki+i ieJj 

And by equation H] we can continue this inequality to 

1 -4e/(l -e) 2 



> 



+ 



Ei 



Finally, combining equations [H [H and [3] we have: 

K 1 K 

|| E E a i S ' 1/2l Pi + E E ii 
i=l ie Jj j=Ai+l ie Jj 

Ki K Ki 

<iiE^E a ^7 v V+ E E^h + iiE^-^E^; 



3=1 ieJj 



j=Ki+l iGJj 



3=1 
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1/2 



< (i + e ) 3/2 ( E ki 2 ) V2 + ^ +^ EE n 2 ) 
< " ( (i + e ) 3/2 + mi + e )7^] (en 2 ) ' ■ 

VieJ / 

Similarly, combining equations [U H] and [5] we have 
Ki K 

ii E E a i s ~ 1/2 <fi + E E a ^ n 

i=i ie J, j=Xi+i is Jj 

>iiE^E g ^7 1/2 ^+ E E a ^ii-iiE( J - p i)E a ^7 1/2 



3=1 itEJj 



> 



l-4e/(l-e) s 



(1 + ^) 2 



Ei 



i=-fsTi+i ieJj 
\ 1/2 



Ai 



1/2 



4e(l + e)v / ^[EEK 



> 



1 -4e/(l -e) ; 

(1 + 6)2 



4e(l + e)V^i 



1/2 



Ek 



□ 



So we can maintain the restricted isometry property after replacement of 
some K\ groups of s vectors in the RIP family by orthonormal sets as long 
as 

1 - 4e/(l - e) 2 



< 

Solving for K\ we have 



Ki < 



4e(l + e)V^i 



1 + e) 2 

1 (l-4e/(l-e) 2 ) 2 



16e 2 (1 + e) 6 

So for sufficiently small e, the fraction on the right hand side is close to one 
and we can let K\ grow like 1/e 2 . 
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